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@ Apparatus for reproducing multiplexed data from a record medium. 



(g) Video data is reproduced from a record 
medium on which is recorded, in multiplexed 
form, the video data, reference time data repre- 
senting a reference time, and video time data 
representing the time at which decoding of the 
video data reproduced firom the record medium 
should begin. The reference time data is sepa- 
rated (5A) from the reproduced multiplexed 
data and used to generate timing data. The 
video data and video time data are temporarily 
stored in a video buffer (6A) and a video time 
data extractor (30) is connected to an output of 
the video buffer to extract the video time data 
from the contents of the video buffer. The video 
buffer (6A) also is connected to a video decoder 
(7) which decodes the video data temporarily 
stored in the video buffer, the operation of the 
video decoder being controlled (31) as a func- 
tion of a comparison between the generated 
timing data and the extracted video time data. 
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This invention relates to apparatus for reproduc- 
ing multiplexed data from a record medium, for exam- 
ple time division multiplexed video and audio data re- 
corded on an optical disk. 

It has been proposed to record digital video and 5 
audio data in a time division multiplexed format in 
successive tracks on a record medium, such as suc- 
cessive circular tracks on an optical disk. The multi- 
plexed data is arranged in a pack, such as in accor- 
dance with a suggested standard (IS01172) of the io 
. Motion Pictures Experts Group (MPEG), and as 
schematically illustrated in Fig. 7 of the accompany- 
ing drawings, one or more packs are recorded in a 
track. A pack is comprised of a pack header followed 
by a video packet and an audio packet. The pack is 
header includes a PACK START CODE which, prefer- 
ably, is in the form of a unique bit pattern which iden- 
tifies the beginning of the pack header, A system 
clock reference SCR follows the PACK START CODE 
and represents a time code corresponding to the 20 
time at which the pack was recorded. The time code 
may represent real time (hours, minutes, seconds, 
etc.) or may be a multi-bit number derived from a sys- 
tem dockthat was turned on when the information on 
the record medium was recorded. For example, the 25 
time at which the last byte in the preceding pack was 
recorded on the record medium may be represented 
by system clock reference SCR. 

The pack header also includes MUX RATE data 
representing a transfer rate, that is, the rate at which 30 
video and audio data included in the video and audio 
packets, respectively, are time division multiplexed. 

The video packet includes a packet header fol- 
lowed by encoded digital video data. The video packet 
header is comprised of a VIDEO PACKET START 35 
CODE whose function is similar to that of the afore- 
mentioned PACK START CODE, namely to identify 
the beginning of the video packet. It is appreciated 
that the VIDEO PACKET START CODE thus is 
formed of a unique bit pattern that may be easily rec- 40 
ognized. Following the VIDEO PACKET START 
CODE is a video decoding time stamp (DTSV) which 
is a multi-bit number that identifies the time at which 
a video decoder initiates its operation to decode the 
video data. As will be described below, in a proposed 45 
reproducing device, the video and audio data are de- 
multiplexed from the pack illustrated in Fig, 7, and 
supplied to respective video and audio decoders. It is 
important that each decoder be supplied with a 
START signal that coincides with the beginning of the so 
video and audio data, respectively, thereby assuring 
that the video decoder properly decodes the video 
data and that the audio decoder properly decodes the 
audio data. The video decoding time stamp DTSV is 
referenced to the system clock reference SCR, the 55 
latter being used to preset a dock which, when incre- 
mented to a value equal to the video decoding time 
stamp DTSV, essentially turns on the video decoder. 



The audio packet is similar to the video packet 
and includes encoded digital audio data which is pre- 
ceded by a packet header. Like the video packet 
header, the audio packet header includes an AUDIO 
PACKET START CODE which, when detected, iden- 
tifies the beginning of the audio packet, followed by 
an audio decoding time stamp DTSA which repre- 
sents the time at which the audio decoder is to be 
turned on to decode the audio data. Like the video 
decoding time stamp DTSV, the audio decoding time 
stamp DTSA is referenced to the system clock refer- 
ence SCR. 

One example of apparatus which has been pro- 
posed to reproduce the multiplexed video and audio 
data exhibiting the forrhat shown in Fig. 7 is illustrat- 
ed in Figs. 6Aand 6B. Assuming that the multiplexed 
data is recorded on an optical disk, the reproducing 
apparatus is comprised of a disk drive 1, a demodu- 
lator 2, an error correcting code (ECC) circuit 3, a ring 
buffer 4, a demultiplexer 5 and, as shown in Fig. 6B, 
separate video and audio decoding channels, each 
being comprised of a buffer and a decoder. Disk drive 
1 is conventional and includes a pickup head which 
reproduces the data packs having the format shown 
in Fig. 7 and supplies same to demodulator 2 which 
demodulates the multiplexed data therefrom. This 
demodulated digital data is supplied to ECC circuit 3 
which, as is conventional, detects the presence of er- 
rors and, based upon known algorithms, corrects 
those errors provided, of course, that such errors are 
not so pervasive as to be uncorrectable. The error 
corrected digital data then is supplied to ring buffer 4 
vyhich stores such data until a predetermined amount 
is accumulated, whereupon the buffer supplies the 
stored data to demultiplexer 5. The ring buffer thus 
provides a buffering action to the operation of the 
ECC circuit, which may be variable, thereby supplying 
a substantially steady stream of data to demultiplexer 
5. 

The demultiplexer includes a data separator 21. 
a video decoding time stamp register 22, an audio de- 
coding time stamp register 24. a dock register 26 and 
comparators 23 and 25. Data separator 21 acts to 
separate the encoded video data, the encoded audio 
data, the system clock reference SCR, the video de- 
coding time stamp DTSV and the audio decoding 
time stamp DTSA from the multiplexed bit stream 
supplied thereto by ring buffer 4. The separated video 
data is supplied to and temporarily stored in video 
buffer 6 and, similarly, the separated audio data is 
supplied to and temporarily stored in audio buffers. 

Clock register 26 is preset by the separated sys- 
tem dock reference SCR and is coupled to a clock 
generator 27 which, in accordance with the HPEG 
standard, generates a 90KHz clock signal. Clock reg- 
ister 26 thus is incremented from its preset count by 
each clock signal generated by dock generator 27, 
thereby producing timing data referred to as system 
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time clock values STC. The system time clock STC 
is coupled in common to comparators 23 and 25. Vid- 
eo decoding time stamp register 22 receives and 
stores the separated video decoding time stamp 
DTSV and supplies this video decoding time stamp to 5 
comparator 23. When the system time clock STC is 
incremented to a count equal to the video decoding 
time stamp DTSV (STC = DTSV), comparator 23 gen- 
erates a video decoding start signal. Similarly, audio 
decoding time stamp register 24 receives and stores io 
the separated audio decoding time stamp DTSA. This 
stored audio decoding time stamp is supplied to com- 
parator 25; and when the system time dock STC is 
incremented to a count that is equal to the audio de- 
coding time stamp DTSA (STC = DTSA), comparator is 
25 generates an audio decoding start signal. 

Video buffer 6 (Fig. 6B) preferably is in the form 
of a first-in first-out (FIFO) memory and supplies 
separated video data to video decoder 7. When com- 
parator 23 produces the video decoding start signal, 20 
the video decoder begins to decode the video data 
temporarily stored in video buffer 6. 

Similarly, audio buffer 8 may be a FIFO memory; 
and supplies the audio data separated by data sepa- 
rator 21 to audio decoder 9. When comparator 25 pro- 25 
duces the audio decoding start signal, the audio de- 
coder is enabled to begin decoding the audio data 
temporarily stored in audio buffer 8. 

Fig. 6Aalso illustrates a control circuit 28, which 
may be a central processing unit, coupled to data sep- 30 
arator 21 to supply various control command signals 
thereto. Control circuit 28 responds to operator-gen- 
erated input signals produced by an input section 29 
for controlling the overall operation of the data repro- 
ducing apparatus. For example, an operator may ac- 35 
tivate input section 29 to produce those signals that 
are typical in optical disk drive devices, such as play, 
stop, pause, skip, etc. Fig. 6A illustrates that input 
section 29 also is coupled to disk drive 1 so as to sup- 
ply such operator-generated input signals thereto. 40 

Fig. 8 is a schematic timing diagram of the timing 
relationship between the operation of data separator 
21 and the video and audio decoders 7 and 9. Let it 
be assumed that a PLAY signal is produced by input 
section 29, whereupon control circuit 28 supplies a 45 
demultiplexing instruction to data separator 21. Let it 
be further assumed that data separator 21 begins its 
demultiplexing operation at time ti (Fig. 8) and, for 
convenience, this time ti may be equal to the system 
clock reference SCR. Accordingly, dock register 26 is so 
preset with this clock value t^ Line A in Fig. 8 illus- 
trates the video data being written into video buffer 6; 
and it is appreciated that the slope of line A corre- 
sponds to the transfer rate at which such video data 
is written therein. Time t2 represents the video decod- ss 
ing time stamp DTSV. Hence, when dock register 26 
is incremented from dock value ti to clock value t2, 
comparator 23 isupplies the video decoding start sig- 



nal to video decoder 7, whereupon a unit of video data 
which had been temporarily stored in video buffer 6 
is decoded. As shown in Fig. 8, this unit is equal to one 
video frame, or one video picture. 

In Fig. 8, line B. which is a discontinuous line, rep- 
resents the video data which is read from video buffer 
6 and decoded by video decoder 7. Fig. 8 also illus- 
trates the capacity of video buffer 6. It will be recog- 
nized that buffer overflow may occur if the rate at 
which video data is read from video buffer 6 is too 
slow, that is, it is less than the rate at which video data 
is written therein. Conversely, buffer underflow may 
occur if the contents of the video buffer are read out 
before a new frame is written therein. The shaded 
area beneath line A schematically illustrates the 
amount of video data remaining in video buffer 6. 

Video decoder 7 produces a vertical synchroniz- 
ing signal when a complete frame of video data has 
been decoded. If the video decoder is coupled to a 
suitable video display, a delay is imparted (VIDEO 
DECODE DELAY) to the decoded video signal prior 
to its display. This delayed relationship also is illu- 
strated in Fig. 8. 

It will be appreciated that the timing relationship 
depicted in Fig. 8 and described above in connection 
with the video decoding channel is equally applicable 
to the audio decoding channel. However, the timing 
relationship, referred to herein as the synchroniza- 
tion relationship, between video decoder 7 and audio 
decoder 9 is dependent upon the presetting of clock 
register 26 by the system clock reference SCR and 
the incrementing of the clock register to system dock 
values that are equal to the video and audio decoding 
time stamps, respectively. But, since the video and 
audio decoding time stamps are separated by data 
separator 21, any variations in the synchronization 
relationship between the video and audio data that 
might occur in or be attributed to the video and audio 
buffers will go undetected. One example of a syn- 
chronization error that may occur in the apparatus 
shown in Figs. 6Aand 68 and thatwill not be detected 
and, thus, not corrected, now will be described. 

Let it be assumed that the data which is repro- 
duced from the disk drive exhibits a high error rate 
such that ECC circuit 3 is unable to correct such er- 
rors. Referring to Fig. 9A, let it be assumed that suc- 
cessive picture intervals reproduced from the optical 
disk are pictures P12, B11, P14, 813, 11, 80, P3 and 
82, wherein the numeral represents the picture inter- 
val and the letter represents the usual MPEG char- 
acterizations, namely I refers to an intraf rame encod- 
ed video picture, P refers to a forward predictive en- 
coded video picture and B refers to a bidirectlonally 
predictive encoded video picture. Assuming no un- 
correctable errors, video decoder 7 decodes the vid- 
eo data included in the successive picture intervals 
supplied thereto and rearranges the decoded data in 
the pnDper picture sequence shown in Fig. 9B. Con- 
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sistent with the MPEG standard, a group of pictures 
(GOP) is comprised of fourteen pictures, or picture in- 
tervals, and the number of the first picture included 
in a GOP is reset to 0. 

Let it be assumed that an uncorrectable error oc- 5 
curs in reproduced picture interval P14, as shown in 
Fig. 9C. For example, video packet header informa- 
tion may be lost. Since video decoder 7 cannot de- 
code video picture P14, the video decoder simply 
skips this picture and, as shown in Fig. 9D, decodes io 
picture intervals P12, B11, B13, 11, BO, P3 and B2 as 
if picture P14 never was present. Consequently, the 
output of the video decoder appears as shown in Fig, 
9E. However, when Fig. 9 E is compared to Fig. 9B, it 
is seen that the decoded picture sequence is ad- 15 
vanced by one picture interval when an error which 
prevents the decoding of picture P14 is present But, 
since a similar error was not present in the audio 
data, audio decoder 9 does not similarly advance the 
units of. audio data decoded thereby. Hence, the de- 20 
coded video and audio data now exhibit loss of syn- 
chronization therebetween. 

Because data separator 21 operates to separate 
the video and audio decoding time stamps from the 
multiplexed data supplied by ring buffer 4, it is struc- 25 
turally difficult to reestablish synchronization be- 
tween the video and audio data supplied to video and 
audio buffers 6 and 8 from data separator 21 when, 
as described above, a unit of video data is lost but a 
unit of audio data is not. Accordingly, to reestablish 30 
synchronization between the video and audio data in 
the presence of the aforementioned error requires 
relatively complicated processing downstream of the 
video and audio buffers. 

Another example of a condition which requires 35 
resynchronization is described with reference to a 
"pause" operation, the timing relationship of which is 
illustrated in Figs. 10A-10C. In the absence of errors, 
and during a normal play operation, video and audio 
data are decoded and displayed in the manner shown 40 
in Fig. 10A. As before, a unit of video data corre- 
sponds to a video picture, or picture interval, and a 
unit of audio data is comprised of a predetermined 
number of samples of the audio information (as one 
example, 512 samples comprise one unit of audio as 
data). It is clearly seen that the length of one unit of 
video data is greater than the length of one unit of au- 
dio data. Moreover, there is no integral multiple rela- 
tionship between the length of a unit of video data and 
the length of a unit of audio data (U ^ hLa, where U 50 
is the length of a unit of video data, La is the length 
of a unit of audio data and n is an integral number). 
As is apparent from Fig. 10A, the synchronization re- 
lationship between the video and audio data thus va- 
ries continually. However, and with reference to an ar- 55 
bitrary picture interval. Fig. 10A illustrates a time dif- 
ference t(j between the beginning of picture interval 
P14 and the beginning of unit A10 of audio data. 



Let it be assumed that the user of the reproducing 
apparatus shown in Figs. 6Aand 6B initiates a pause 
operation during the time that picture interval B13 is 
displayed, as illustrated in Fig. 10B. As a result of this 
pause operation, picture interval B13 is repeatedly 
displayed. Audio decoder 9 decodes units A7. A8 and 
A9 of audio data; but since unit A10 accompanies pic- 
ture interval P14 and since picture P14 is not decod- 
ed and displayed, a muting condition exists after unit 
A9 of audio data is decoded. This muting condition 
also is illustrated in Fig. 108 and coincides with the 
repeated display of picture B13. 

When the pause operation ends, as shown in Fig. 
IOC, the next picture interval P14 is displayed; and 
at a time following the beginning of picture interval 
P14, the next unit A10 of audio data is decoded. For 
proper synchronization between the video and audio 
data, decoding of unit A10 must begin at the delayed 
time td following the beginning of picture P14. 

However, in the reproducing apparatus shown in 
Figs. 6A and 6B, picture interval P14 and unit A10 of 
audio data are separated early on from the multi- 
plexed data reproduced from the optical disk and, 
likewise, the video and audio decoding time stamps 
are stored early on in registers 22 and 24. With the 
separated video picture P14 stored in video buffer 6, 
the separated unit A10 of audio data stored in audio 
buffers, the video decoding time stamp DTSV stored 
in register 22 and the audio decoding time stamp 
DTSA stored in register 24, the time difference td be- 
tween the beginning of video picture P14 and unit A10 
of audio data is quite difficult to detect Hence, and 
since this delay t^ is variable, as discussed above, it 
is difficult to restore proper synchronization to the 
video and audio data at the conclusion of a pause op- 
eration. 

Another drawback associated with the apparatus 
shown in Figs. 6A and 6B occurs when disk drive 1 op- 
erates to re-read data from, for example, a particular 
sector because a high error rate has prevented the 
originally read data from being properly interpreted. 
For instance, if the disk drive is subjected to shock, 
vibration or mechanical interference whereby data 
which is read from a portion of the disk appears as 
an uncorrectable error, control circuit 28 may. in re- 
sponse to this uncorrectable error, command the disk 
drive to re-read the same portion of the record me- 
dium. Typically, such re-reading results in corrected 
data which then may be accurately decoded. For ex- 
ample, if the disk drive is a CD-ROM, up to a maxi- 
mum of 300 milliseconds may be required to access 
and re-read the same portion of the disk. But, during 
the re-read operation, the supply of new video and 
audio data to video and audio buffers 6 and 8 is in- 
terrupted. Nevertheless, the data that had been stor- 
ed previously therein is decoded. As a consequence, 
the contents of ring buffer 4, video buffer 8 and audio 
buffer 8 may be exhausted before new data is sup- 
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plied thereto. This underflow condition may result in 
noticeable interruptions in the displayed video pic- 
ture and audio sound; and constitutes a drawback 
that desirably should be avoided. 

In accordance with this invention, apparatus is 5 
provided for reproducing video data from a record me- 
dium on which is recorded, in multiplexed form, the 
video data, reference time data representing a refer- 
ence time, and video time data representing the time 
at which decoding of the video data reproduced from io 
the record medium should begin. The reference time 
data is separated from the multiplexed data and used 
to generate timing data. The video data and video 
time data which are reproduced from the record me- 
dium are stored in a video buffer, and the video time 15 
data in that buffer is extracted. The buffer is connect- 
ed to a video decoder which decodes the video data 
temporarily stored in the buffer and the operation of 
the video decoder is con trolled as a function of acom- 
. parison between the generated timing data and the 20 
extracted video time data. 

Decoding of the video data may be initiated when 
the generated timing data Is substantially equal to the 
extracted video time data. A synchronizing error may 
be indicated when the generated timing data and the 25 
extracted video time data differ from each other by 
at least a predetermined amount. Preferably, if the 
extracted video time data exceeds the generated 
timing data by at least this amount, the decoding of 
video data by the video decoder is delayed by a pic- 30 
ture Interval, that is, the video decoder is caused to 
wait. Conversely, if the generated timing data ex- 
ceeds the extracted video time data by at least the 
aforementioned predetermined amount, the video 
decoder preferably skips to the next video picture to 35 
carry out a decoding operation thereon. 

The multiplexed data recorded on the record me- 
dium may also include audio data and audio time data 
representing the time at which decoding of the repro- 
duced audio data should begin. The apparatus may 40 
in that event further include an audio buffer for tem- 
porarily storing the audio data and audio time data 
which are reproduced from the record medium, an au- 
dio time data extractor for extracting the audio time 
data from the reproduced audio data, and an audio 45 
decoderfor decoding the reproduced audio data tem- 
porarily stored in the audio buffer, the audio decoder 
being controlled as a function of a comparison be- 
tween the generated timing data and the extracted 
audio time data. 50 

An interrupt command may be generated to tem- 
porarily interrupt the reproduction of new multiplexed 
data from the record medium. The video decoder may 
respond to the interrupt command to delay until the 
interrupt command terminates the decoding of the 55 
next picture interval of video data. Preferably, the 
timing data is frozen for the duration of the interrupt 
command and the decoder is inhibited from decoding 



the video data of the next picture interval when the 
extracted video time data is greater than the frozen 
timing data. The generation of timing data may re- 
sume when the interrupt command terminates; and 
once the timing data exceeds the extracted video 
time data, the video decoder may then decode the 
next picture interval. 

A re-read command may be generated to cause 
a portion of the record medium to be re-read and, 
concurrently, to cause the video decoder to delay the 
decoding of video data in the video buffer until the re- 
read video data is supplied thereto. The timing data 
may be frozen until the re-read video data is supplied 
to the video buffer; and the video decoder may be in- 
hibited from decoding video data when the extracted 
video time data is greater than the frozen timing data. 
The generation of timing data may be resumed when 
the re-read data is supplied to the video buffer; and 
the video decoder may be enabled when the gener- 
ated timing data exceeds the extracted video time 
data. 

The video time data extractor may be connected 
to the output of the video buffer such that the video 
time data is extracted immediately upstream of the 
video decoder. Similarly, the audio time data extrac- 
tor may be connected to the output of the audio buffer 
such that audio time data is extracted immediately 
upstream of the audio decoder. Consequently, syn- 
chronization errors may be detected easily and accu- 
rately. This also permits the ready detection of an 
overflow or underflow condition of the video buffer 
merely by comparing the extracted video time data 
with the generated timing data. Likewise, the pres- 
ence of an overflow or underflow condition of the au- 
dio buffer may be easily detected simply by compar- 
ing the extracted audio time data with the generated 
time data. Furthermore, synchronization between 
the video and audio data may be determined simply 
by comparing the extracted video time data with the 
extracted audio time data. . 

Embodiments of the invention described herein- 
below provide: 

data reproducing apparatus which avoids or al- 
leviates the aforenoted drawbacks, disadvantages 
and defects of other proposals; 

data reproducing apparatus which reproduces 
multiplexed video and audio data and detects and 
corrects synchronization errors that may be present 
therebetween; 

apparatus of the aforenoted type which facili- 
tates the recovery of proper synchronization between 
reproduced video and audio data at the conclusion of 
a pause operation; 

apparatus of the aforenoted type which avoids 
the occurrence of an underflow condition in the event 
that data is re-read from a portion of a record me- 
dium; 

apparatus of the aforenoted type which selec- 
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tively provides a wait or a skip operation in the decod- 
ing of video pictures in the event of a detected loss of 
synchronization; 

apparatus of the aforenoled type in which re- 
synchronization following a pause operation and fol- 
lowing a re-read operation are carried out in similar 
fashion; and 

such an apparatus which senses synchroniza- 
tion errors and controls video and audio decoding as 
a function of those errors. 

The invention will now be further described, by 
way of illustrative and non-limiting example, with ref- 
erence to the accompanying drawings, in which: 

FIG. 1 , which is formed from FIGS, 1 A and 1 B, is 

a block diagram of data reproducing apparatus 

embodying the invention; 

FIG. 2 is a schematic illustration of the structure 
of data stored in an audio buffer 8Aof FIG. 1B; 
FIGS. 3A-3F are timing diagrams which are use- 
ful In understanding advantages derived from the 
apparatus of FIG. 1; 

FIG. 4; which is formed from FIGS. 4A and 48, is 
a block diagram of data reproducing apparatus 
embodying the invention which is similar to that 
shown in FIG. 1, but with certain modifications 
thereto; 

FIGS. 5A-5D are timing diagrams which are use- 
ful in understanding advantages derived from the 
apparatus of FIG. 4; 

FIG. 6. which is formed from FIGS. 6A and 68. is 
a block diagram of a previously proposed data re- 
producing apparatus; 

FIG. 7 is a schematic representation of a multi- 
plexed data format of data reproduced in the ap- 
paratuses of FIGS. 1 , 4 and 6; 
FIG. 8 is a schematic representation of timing re- 
lationships which are useful in understanding the 
manner in which the apparatus of FIG. 6 oper- 
ates; and 

FIGS. 9A-9E and 10A-10C are timing diagrams 
which are useful in explaining drawbacks and dis- 
advantages associated with the apparatus of 
FIG. 6. 

Referring now to the drawings, wherein like ref- 
erence numerals are used throughout, Figs. lAand 
IB, when arranged as shown in Fig. 1, comprise a 
block diagram illustrative of data reproducing appa- 
ratus embodying the invention. It will be appreciated 
that the data reproducing apparatus shown in Figs. 
1 A and 1 B is quite similar to that shown in Figs. 6A 
and 68; and for convenience and simplification, and 
in an effort to avoid unnecessary duplication, only 
those differences between the apparatus previously 
described with respect to Figs. 6Aand 6B and the ap- 
paratus now described in connection with Figs. 1A 
and IB will be explained. Demultiplexer 5A in Fig. 1A 
differs from demultiplexer 5 in Fig. 6A in that demul- 
tiplexer 5A does not include video decoding time 



stamp register 22, audio decoding time stamp regis- 
ter 24 or comparators 23 and 25. Rather, demultiplex- 
er 5A includes a data separator 21 A which, as op- 
posed to data separator 21. does not separate video 

5 decoding time stamp data DTSV from the encoded 
video data. For a reason discussed below, data sep- 
arator 21A demultiplexes the audio data and the au- 
dio decoding time stamp data DTSA but, as will be 
discussed, the demultiplexed audio data and audio 

10 decoding time stamp data are stored in an audio buf- 
fer 8A (Fig. 1 B) in a manner which, nevertheless, re- 
tains the timing relationship therebetween. 

Data separator 21 A also separates the system 
clock reference SCR which is used to preset clock 

15 register 26, the latter being incremented in response 
to a QOKHz clock signal generated by clock generator 
27 to generate the timing data STC of the system 
time clock. 

Video buffer 6A of Fig. 1 B is similar to aforede- 
20 scribed video buffer 6 and is coupled to data separa- 
tor 21 A to receive therefrom the video data and the 
video decoding time stamp data DTSV in their time 
division multiplexed form (as shown in Fig. 7). The 
output of the video buffer is coupled to a video decod- 
25 ing time stamp extractor 30 which is adapted to ex- 
tract from the multiplexed video data temporarily 
stored in video buffer 6A the video decoding time 
stamp data DTSV. The video buffer also is connected 
to video decoder 7 to supply to the video decoder the 
30 video data from which the video decoding time stamp 
data has been extracted. Thus, and contrary to the 
previously proposed apparatus shown in Figs. 6A and 
68, the video decoding time stamp data and the video 
data are stored together in video buffer 6A, thus pre- 
ss serving their synchronizing relationship, and the vid- 
eo decoding time stamp data DTSV is not extracted 
until the video data is supplied to video decoder 7. 

A synchronization control circuit 31 (Fig. IB) is 
coupled to dock register 26 to receive therefrom the 
40 timing data generated by the clock register as the 
preset count therein Is incremented in response to the 
90KHz clock signals supplied by clock generator 27. 
The synchronization control circuit also is coupled to 
video decoding time stamp extractor 30 and. as one 
45 example, may include coincidence detectors to detect 
when the timing data generated by the clock register 
has been incremented to be equal to the extracted 
video decoding time stamp data DTSV. As will be de- 
scribed, synchronization control circuit 31 also is 
50 adapted to determine when the extracted video de- 
coding time stamp data exceeds the generated tim- 
ing data (DTSV > STC) and also to determine when 
the generated timing data is greater than the extract- 
ed video decoding time stamp data (STC > DTSV). A 
55 control signal is supplied from the synchronization 
control circuit to video decoder 7 to control the oper- 
ation of the video decoder in response to the detected 
synchronization relationship of the video data, that is. 
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and as one example thereof, the operation of the vid- 
eo decoder is controlled as a function of the relation- 
ship between the generated timing data STC and the 
extracted video decoding time stamp data DTSV. 

Data separator 21 A demultiplexes the audio de- s 
coding time stamp data DTSA from the audio data 
which are supplied thereto in an audio packet from 
ring buffer 4 for the reason now to be described. As 
mentioned above, the construction of the reproduced 
video and audio data is. as shown in Fig. 7. establish- io 
ed by the MPEG standard. In accordance with this 
standard, it is possible that the bit pattern of the AU- 
DIO PACKET START CODE included in the audio 
packet header may appear as actual information 
data. Consequently, if the audio data and the audio is 
decoding time stamp data DTSA are maintained in 
their multiplexed form in audio buffer 8A, there is the 
possibility that actual information may be misinter- 
preted as an AUDIO PACKET START CODE, thereby 
introducing errors into the AUDIO PACKET START 20 
CODE detection operation. As a result the audio de- 
coding time stamp data DTSA. whose detection is de- 
pendent upon proper detection of the AUDIO PACK- 
ET START CODE, may not be sensed. Therefore, to 
avoid this possibility, data separator 21 A operates as 25 
a time division demultiplexer for the audio data, 
thereby assuring proper separation and detection of 
the audio decoding time stamp data DTSA. As is seen 
from Figs. 1Aand 1B, the separated audio data and 
audio decoding time stamp data DTSA are supplied 30 
to separate inputs of audio buffer 8A; and as will now 
be explained with reference to Fig. 2, the synchroni- 
zation relationship between the audio data and the 
audio decoding time stamp data DTSA nevertheless 
is maintained in audio buffer 8A, notwithstanding this 35 
separation. 

As seen in Fig. 2, the audio information stored in 
audio buffer 8A (as used herein, the expression "au- 
dio information" means both the separated audio 
data and the audio decoding time stamp data DTSA) 40 
is identified by a flag bit. In particular, this flag bit is 
affixed to each audio information character (such as 
an audio information byte) and identifies audio data 
when the flag bit is reset to "0" and audio decoding 
time stamp data DTSA when the flag bit is set to "1". 45 
Thus, even though data separator 21A has demulti- 
plexed the audio decoding time stamp data and the 
audio data, such demultiplexed audio information 
nevertheless is stored in audio buffer 8A with their 
original timing relationship, as represented by the so 
flag bits of the audio information characters shown in 
Fig. 2. Hence, both audio buffer 8A and aforedescri- 
bed video buffer 6A maintain the synchronization re- 
lationship of the audio and video data respectively 
stored therein by reason of the fact that these buffers 55 
also store the audio and video decoding time stamp 
data of their respective audio and video packets. 
Audio buffer 8A is similar to afored escribed audio 



buffer 6 and is connected to audio decoding time 
stamp extractor 32 which is adapted to extract from 
the contents of the audio buffer the audio decoding 
time stamp data DTSA. The audio buffer also is con- 
nected to audio decoder 9 to supply thereto the tenr>- 
porarily stored audio data for decoding. It is appreci- 
ated that, in the reproducing apparatus shown in 
Figs. 1Aand IB, the audio decoding time stamp data 
DTSA is maintained with the audio data until the au- 
dio data is supplied to audio decoder 9, thereby main- 
taining the synchronization relationship of the audio 
data. 

The extracted audio decoding time stamp data 
DTSA is supplied by extractor 32 to synchronization 
control circuit 31 for comparison with the timing data 
STC generated by clock register 26. The synchroni- 
zation control circuit senses when the timing data 
has been incremented to a value equal to the extract- 
ed audio decoding time stamp data (STC = DTSA), 
and also senses when the audio decoding time stamp 
data DTSA is greater than the timing data (DTSA > 
STC) and when the timing data is greater than the au- 
dio decoding time stamp data (STC > DTSA). The op- 
eration of audio decoder 9 is controlled as a function 
of this detected synchronization relationship, that is, 
the relationship between the timing data STC and 
the extracted audio decoding time stamp data DTSA. 
In addition, synchronization control circuit 31 func- 
tions to compare the value of the extracted video de- 
coding time stamp data to the value of the extracted 
audio decoding time stamp data for the purpose of 
detecting and correcting a synchronization error be- 
tween the video and audio decoders. 

The manner in which the reproducing apparatus 
illustrated in Figs. 1Aand 1 B operates now will be de- 
scribed with reference to Figs. 3A-3F. Let it be as- 
sumed that video and audio data are recorded on a 
record medium, such as an optical disk, in the MPEG 
format shown in Fig. 7. Let it be further assumed that 
the recorded video data represents successive pic- . 
ture intervals P12. 811, P14, B13, i1, BO. P3 and 82. 
as i llustrated in Fig. 3A. It is f urt her assumed that the 
video decoding time stamp data that is recorded in 
the video packet header at the beginning of each of 
these picture intervals is, as illustrated in Fig. 3A, 
represented by the values N+0. N+3003, N+6006, 
N+9009, ...N+x(3003), where x represents the suc- 
cession of picture intervals. Since clock generator 27 
generates a 90KHz clock signal, and since the video 
frame rate (or picture interval rate) in the NTSC sys- 
tem is 29.97Hz, then the number of clock signals 
which are generated in a frame or picture interval is 
90KHZ/29.97HZ = 3003. 

The multiplexed video and audio data repro- 
duced from the record medium by. for example, disk 
drive 1, are demodulated, subjected to error sensing 
and correction by ECC circuit 3 and stored in ring buf- 
fer 4. The multiplexed data are read from the ring buf- 
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fer to demultiplexer 5A; and data separator 21 A sup- 
plies to video buffer 8A the video data and video de- 
coding time stamp data DTSV (which maintain their 
time division multiplexed form and, thus, maintain 
their synchronization relationship) and also supplies 5 
to audio buffer 8A the demultiplexed audio data and 
audio decoding time stamp data DTSA which, never- 
theless, and as has been described above, also main- 
tain their synchronization relationship. Data separa- 
tor 21 A also separates the system clock reference io 
SCR from the reproduced multiplexed data to preset 
clock register 26 with this reference value. This preset 
value is incremented by the 90KHz clock signal gen- 
erated by clock generator 27 to produce timing data 
STC which is compared, in synchronization control 15 
circuit 31 , to the extracted video decoding time stamp 
data DTSV and also to the extracted audio decoding 
time stamp data DTSAsupplied thereto by extractors 
30 and 32, respectively, in Fig. 3A, the value of the 
generated timing data is illustrated along the horizon- 20 
tal axis below the value of the extracted video decod- 
ing time stamp data DTSV. When STC = DTSV, syn- 
chronization control circuit 31 supplies a suitable sig- 
nal to video decoder 7 (e.g. a start signal, an enable 
signal, a control command, or the like), whereupon 25 
the video decoder begins to decode the video data 
stored in video buffer 6A. The decoded video data is 
supplied as a video output signal to further appara- 
tus, not shown, (such as a video display device). Al- 
though not specifically illustrated and described 30 
herein, it will be appreciated that, in a similar manner, 
audio decoder 9 is controlled by synchronization con- 
trol circuit 31 to decode the audio data stored in audio 
buffer 8 A wh en STC = DTSA. 

Fig. 3B illustrates the output of video decoder 7. 35 
also referred to herein as the display output, and it is 
seen that the decoded video pictures are restored to 
their original sequence, namely 811, P12, B13, P14, 
BO, \^iB2 and P3. For consistency, it is appreciated 
that the picture intervals which are supplied to decod- 40 
er7 in Fig. IB are the same as the picture intervals 
shown in Fig. 9A (and supplied to decoder 7 of Fig. 
68). and the decoder output shown in Fig. 38 is the 
same as the decoder output shown in Fig. 98. This 
consistency is maintained to best appreciate the ad- 45 
vantages of the apparatus embodying the invention. 

Now, let it be assumed that an uncorrectable er- 
ror is present In reproduced picture interval P14, as 
represented by the "X" in Fig. 3C. As an example, the 
video packet header information of picture interval 50 
P14 may be lost, thereby making it impossible to re- 
cover and display this picture. It will be recalled that 
this same error condition was assumed when de- 
scribing Fig. SC. Accordingly, since picture interval 
P14 is not reproduced, ring buffer 4 supplies to data 55 
separator 21 A picture interval 811 followed by picture 
interval 81 3, thereby omitting picture interval PI 4, as 
shown in Fig. 3D. However, although the video data 



of picture interval PI 4 Is not supplied to data separa- 
tor 21 A, it is assumed that the pack header of this pic- 
ture interval is and', therefore, data separator 21A 
separates the system clock reference SCR from this 
supplied data, thereby presetting clock register 26 
with this value. Alternatively, the clock register may 
be phase-lock controlled so as to increment to this 
value. 

But. since the video data of picture interval PI 4 
is not supplied by ring buffer 4. data separator 21 A 
next receives the video data of picture interval B13. 
This video data is transferred to. video buffer 6A by 
the data separator and the video decoding time 
stamp data DTSV is extracted therefrom and sup- 
plied to synchronization control circuit 31. As is seen 
from Figs. 3Aand 3D, the video decoding time stamp 
data of picture interval B13 is assumed to be DTSV 
= N+9009. 

Clock register 26, which had been preset by (or 
incremented to) the system clock reference SCR as- 
sociated with picture interval PI 4 is incremented, and 
the timing data thus generated by the clock register 
is assumed herein to be incremented to a value STC 
= N+6006. Synchronization control circuit 31 conr>- 
pares the extracted video decoding time stamp data 
DTSV to the generated timing data STC and senses 
when DTSV - STC = 3003. That is, the synchroniza- 
tion control circuit detects when the difference be- 
tween the extracted video decoding time stamp data 
and the generated timing data differ from each other 
by an amount substantially equal to a video frame, or 
picture interval. Consequently, the synchronization 
control circuit determines that a synchronization er- 
ror has occurred in the decoding of the video data and 
supplies a "wait" control signal to video decoder 7, 
thereby delaying for one picture interval the decoding 
of the video data stored in video buffer 6A. This con- 
trol over the video decoder is schematically illustrat- 
ed in Fig. 3E wherein the decoding of the video data 
stored in video buffer 6A, namely the video data of 
picture interval 813, is delayed by one picture inter- 
val. As a result of this delay, the proper synchroniza- 
tion relationship between the timing data generated 
by clock register 26 and the extracted video decoding 
time stamp data is restored. 

As shown in Fig, 3F. while the decoding of picture 
interval B13 is delayed by one picture interval, the 
previously decoded picture interval simply is repeat- 
ed, thereby avoiding a discontinuity in the video pic- 
tures being displayed. Stated otherwise, the "gap" 
formed by delaying the decoding of picture interval 
813 is "filled" by repeating the previously decoded 
picture. 

It is recognized from the foregoing discussion 
that in the event of an uncorrectable error which 
makes it impossible to reproduce a unit of video data 
(i.e. a picture interval), the video decoder is control- 
led to delay, or wait, by one unit. Similarly, if an un- 
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correctable error makes it impossible to recover a unit 
of audio data (as described herein, one unit has been 
assumed to be comprised of 512 audio samples, al- 
though the length of an audio unit is not necessarily 
limited to this amount), synchronization control circuit 5 
31 controls audio decoder 9 so as to delay the decod- 
ing of audio data by one or more audio units. To pre- 
vent, or at least minimize, the occurrence of unde- 
sired or disagreeable sounds, which may be sensed 
as "clicks" or other harsh noise, audio muting is per- io 
formed for a duration prior to and after the location of 
the error. 

The foregoing discussion has explained the man- 
ner in which synchronization error correction is at- 
tained by delaying the operation of video decoder 7 is 
or audio decoder 9. If, however, an erroneous video 
decoding time stamp DTSV is reproduced, for exam- 
ple, if a portion of the video decoding time stamp data 
is obliterated and this error is not corrected, syn- 
chronization control circuit 31 controls video decoder 20 
7 to "skip" its decoding operation by one video unit. 
For example, if STC - DTSV = 3003, the video decod- 
er skips to the next unit of video data to be loaded into 
video buffer 6A and does not decode the video data 
that had been previously stored therein. 25 

A comparison of the video decoding time stamp 
data DTSV to the timing data STC generated by clock 
register26 may be useful in anticipating an underflow 
or overflow condition of video buffer 6A. For example, 
the condition DTSV > STC may signify that the video 30 
decoding operation is advanced, and this possibly 
may result in a buffer underflow condition. Correction 
for such a possible underflow is achieved simply by 
supplying a delay instruction to video decoder 7 from 
synchronization control circuit 31, thereby restoring 35 
the proper synchronization relationship. Conversely, 
if DTSV < STC, the possibility of a buffer overflow 
condition is indicated. This overflow may be correct- 
ed simply by supplying to video decoder 7 from syn- 
chronization control circuit 31 a skip instruction. This 40 
overflow/underflow indication is easily sensed be- 
cause the video decoding time stamp data remains in 
its multiplexed form with the video data in video buf- 
fer 6A and is not separated upstream thereof by data 
separator 21A (as is the case in the arrangement 45 
shown in Figs. 6A and SB). That is, since the timing 
relationship of the video data is maintained in the vid- 
eo buffer, the extraction of the video decoding- time 
stamp data therefrom permits a simple and ready in- 
dication of possible buffer underflow or overflow. so 

In similar manner, a possible underflow or over- 
flow condition of audio buffer 8A may be sensed by 
determining if DTSA > STC or DTSA < STC. Correc- 
tion may be attained by controlling audio decoder 9 
to delay or skip its decoding operation; and to prevent 55 
the occurrence of a disagreeable sound because of 
such delay or skip, muting is performed for a duration 
prior to and following the detection of the synchroni- 



zation error. 

In the embodiment described herein, the video 
decoding time stamp extractor 30 is connected di- 
rectly to the output of video buffer 6Aand is disposed 
in a stage upstream of video decoder 7. Similarly, au- 
dio decoding time stamp extractor 32 is connected di- 
rectly to the output of audio buffer 8A and is disposed 
in a stage that is immediately upstream of audio de- 
coder 9. As an alternative, extractors 30 and 32 may 
be disposed directly in decoders 7 and 9, respective- 
ly. 

As a further modification to the afored escribed 
embodiment, the video and audio decoding time 
stamp data may be replaced by alternative, yet equiv- 
alent, time data known as presentation time stamp 
(PTS) data. Such presentation time stamp data may 
be disposed in some, although not necessarily all, 
packet headers to represent the time at which the vid- 
eo or audio unit in that packet should be displayed. It 
will be recognized that a predetermined relationship 
exists between the presentation time stamp and the 
time at which decodingof the video data or audio data 
should begin. Hence, extractors 30 and 32 may in- 
clude appropriate conversion circuits to convert the 
presentation time stamp data to video and audio de- 
coding start signals, respectively. 

A modification of the embodiment shown in Figs. 
lAand IB now will be described in conjunction with 
the block diagram of Figs. 4A and 4B, arranged as 
shown in Fig. 4. The significant difference between 
these embodiments is seen by comparing Fig. 4A to 
Fig. 1A, In Fig. 1A, control circuit 28 receives input 
signals from input section 29 and supplies corre- 
sponding instructions to data separator 21 A, such as 
play, pause, etc. As also shown in Fig. 1A, such input 
signals as are generated by input section 29 are sup- 
plied to disk drive 1 to initiate a corresponding repro- 
duction operation. It is also seen that the arrange- 
ment between input section 29, control circuit 28 and 
disk drive 1 in Fig. 1Ais substantially the same as that 
shown in Fig. 6A. However, in Fig. 4A, input section 
21 is coupled only to control circuit 28A which, in turn, 
supplies corresponding command instructions to 
disk drive 1, data separator 21A and clock register 
26A. As also seen from Fig. 4A. control circuit28A re- 
ceives a status indication from ECC circuit 3 which is 
indicative of an error condition that cannot be correct- 
ed. Accordingly, to make it clear that the control cir- 
cuit and clock register of Fig. 4A are not identical to 
those of Fig. 1A, the suffix "A" is used. 

In the embodiment of Fig. 4A. control circuit 28A 
is adapted to supply to disk drive 1 a "re-read" com- 
mand which is adapted to control the disk drive to re- 
read the data from a particular portion thereon in the 
event that such data, when originally read, could not 
properly be interpreted. For example, and assuming 
that the data packs shown in Fig. 7 are recorded in 
sectors (for example, one or more packs may be re- 
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corded in a single sector), the re-read command may 
control the disk drive to re-read the last sector from 
which data had been reproduced. Typically, this re-re- 
ad command may be supplied to disk drive 1 when an 
error occurs because the disk drive had been subject- 5 
ed to shock or vibration. 

In addition, control circuit 28A is adapted to sup- 
ply to clock register 26A a command which enables or 
inhibits the clock register to count clock signals. In re- 
sponse to an enable command, the clock register op- io 
erates in its normal mode to count the clock signals 
generated by clock generator 27, thereby increment- 
ing the timing data STC. In response to an inhibit 
command, the clock register "freezes" the count val- 
ue stored therein and no longer counts the clock sig- is 
nals supplied by clock generator 27 until the enable 
command is next received. 

. As an example of the manner in which the em- 
bodiment shown in Figs. 4Aand 4B operates, let it be 
assumed that, during a normal play operation, a user 20 
of the apparatus initiates a pause operation. For ex- 
ample, a pause switch of input section 29 may be ac- 
tuated. As a result, control circuit 28A supplies a 
pause command to disk drive 1 , whereupon the read- 
ing of further video and audio data from the record 25 
medium is interrupted. Of course, at this time, video 
and audio information that had been read prior to the 
initiation of the pause operation are stored in video 
and audio buffers 6A and 8A. More particularly, and 
as illustrated in Fig. 5A, if a pause operation had not 30 
been initiated, video decoder 7 would be supplied 
with successive video pictures P12. B11, P14, B13, 
II, BO, P3 and B2 reproduced from the record me- 
dium. This is the same sequence of picture intervals 
supplied to the video decoder as has been described 35 
hereinabove with respect to Fig. 3A, Fig. SAalso illus- 
trates the video decoding time stamp data DTSV in- 
cluded in the video packet header for each of the in- 
dicated picture intervals; and Fig. SAaddilionally rep- 
resents the value of the timing data STC as clock reg- 40 
ister 26A is incremented by clock generator 27. That 
is, and as has been discussed above, during normal 
operation to decode the reproduced video data, clock 
register 26A is preset by the separated system clock 
reference data SCR and then, when incremented 45 
such that STC = DTSV, video decoder 7 is controlled 
by synchronization control circuit 31 to begin the de- 
coding of the video data stored in video buffer 6A. 
Consequently, during a normal play operation, the 
video decoder supplies the successive picture inter- so 
vals for display, as shown in Fig. 5B. 

Let it be assumed that the pause operation is ini- 
tiated at the point in time that video data of picture in- 
terval PI 4 is being decoded by video decoder 7, such 
as illustrated In Fig. 5C. Let it be further assumed that 55 
the timing data produced by clock register 26Aatthe 
time control circuit 28A produces the pause com- 
mand exhibits the value STC = N + 8000. The clock 



register responds to this pause command to interrupt 
its clock signal counting operation, thereby freezing 
the timing data therein at the value STC = N+8000. 
As shown in Fig. 5C, although the value of the timing 
data is frozen, video decoder 7 nevertheless contin- 
ues to operate and completes its decoding of the vid- 
eo data in picture interval PI 4. When the video de- 
coder attempts to decode the video data of the next 
picture interval B13. the video decoding time stamp 
data DTSV included in the packet header of picture 
interval B13 is compared in synchronization control 
circuit 31 to the timing data of clock register 26A. It is 
seen, however, that since the timing data has re- 
mained frozen at STC = N+8000, and since the video 
decoding time stamp data of picture interval B13 is 
DTSV = N+9009, the synchronization control circuit 
senses DTSV > STC. Consequently, and as has been 
described above, synchronization control circuit 31 
controls video decoder 7 to delay the decoding of the 
video data stored in video buffer 6A. That is. the video 
decoder waits until an enable control signal is sup- 
plied thereto by the synchronization control circuit. Of 
course, while decoder 7 waits to decode the video 
data in the next picture interval from video buffer 6A, 
the video picture that had been previously supplied 
as an output video signal from the video decoder, 
namely picture PI 2. is repeatedly supplied as the out- 
put video signal, as shown in Fig. 5D. 

It is appreciated that, although not shown herein, 
a similar wait control of audio decoder 9 is effected 
when the pause operation is selected. Of course, and 
as has been discussed above, audio muting is effect- 
ed during the duration of the pause operation. 

Let It now be assumed that the user terminates 
the pause operation at the point of time illustrated in 
Fig. 5C. Accordingly, control circuit 28A supplies to 
disk drive 1 a play command, whereupon further data 
packs once again are reproduced from the record me- 
dium, and the control circuit also supplies to clock 
register 26A an enable command, whereupon the 
clock register once again Increments its count value 
in response to clock signals supplied thereto by clock 
generator 27. Accordingly, the clock register now in- 
crements its count from STC = N+8000. As the timing 
data STC produced by clock register 26A increases, 
synchronization control circuit 31 will sense when 
STC > DTSV. At that time, the synchronization con- 
trol circuit supplies an enable signal to video decoder 
7, whereupon the video decoder begins to decode the 
video data of the next picture interval stored in video 
buffer 6A. 

In the aforedescribed pause operation, the time 
at which clock register 26A is inhibited and subse- 
quently enabled is seen to be arbitrary and random 
with respect to the decoding by video decoder 7 of 
video data stored in video buffer 6A. Hence, the rela- 
tionship between the video decoding time stamp and 
the timing data produced by clock register 26A is lost 
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when the pause operation is canceled. Consequent- 
ly, it is theoretically possible that the timing data may 
be incremented to the value STC = N+10000 at the 
point in time that video decoding time stamp extrac- 
tor 30 extracts from the video information stored In 5 
video buffer 6A the video decoding time stamp data 
DTSV = N+9009. This theoretical possibility is illu- 
strated in Fig. 5C. To correct this possible problem, 
extractor 30 and/or synchronization control circuit 31 . 
clock register 26 and control circuit 28A may be sup- io 
plied with a synchronizing signal produced by video 
decoder 7 (or another video processing circuit, not 
shown) so that the beginning and the ending of a 
pause operation are synchronized with the video sig- 
nal or the decoding thereof. This will maintain the i5 
proper relationship between the extracted video de- 
coding time stamp data DTSV and the tinning data 
STC produced by clock register 26A, 

A slow play operation (e.g. a slow motion display) 
is analogous to a pause operation. In particular, when 20 
input section 29 supplies to control circuit 28A a slow 
play input signal, the control circuit controls disk drive 
1 and clock register 26A to carry out alternate play 
and pause operations. For example, a slow motion 
display on the onjer of one-half speed is effected if 25 
the pause operation is carried out for a duration of 
one picture interval, followed by a play operation for 
one picture interval, followed by a pause operation, 
and so on. A slow motion display of 1/3 speed is ef- 
fected if the pause operation is carried out for two pic- 30 
ture intervals followed by a play operation of one pic- 
ture interval. Of course, the manner in which clock 
register 26A, synchronization control circuit 31 and 
video and audio decoders 7 and 9 are controlled dur- 
ing a pause operation has been discussed above. 35 

Since a pause operation may be used to reflect 
what is commonly referred to by a consumer as a true 
"pause" mode and also is used to effect a variable 
slow motion play mode, it would be more accurate to 
describe the aforementioned operation as if control 40 
circuit 28A generates an interrupt command to tem- 
porarily interrupt the reproduction of new multiplexed 
data from the record medium by disk drive 1. 

Let it be assumed that disk drive 1 is subjected to 
an impact, such as shock or vibration, making it im- 45 
possible for ECC circuit 3 to correct the resultant er- 
rors which are present in the reproduced data. In that 
event, the ECC circuit supplies to control circuit 28A 
ECC STATUS data which indicates that an uncorrect- 
able error has occurred and further identifies the Io- so 
cation of the record medium (e.g. the sector number) 
from which the data containing that uncorrectable er- 
ror has been reproduced. In response to this ECC sta- 
tus data, control circuit 28A supplies a re-read com- 
mand to disk drive 1 and also supplies to clock register 55 
26Athe aforementioned interrupt command. As a re- 
sult, the operation of the dock register, synchroniza- 
tion control circuit 31. video decoder 7 and audio de- 



coder 9 is substantially the same as has been descri- 
bed hereinabove with respect to a pause operation. 
While video decoder 7 is inhibited from decoding vid- 
eo data from the next picture interval in video buffer 
6A, and continues to supply as an output for display 
the previously decoded picture interval, disk drive 1 
re-reads the video data from the same location (or 
sector) from which the uncorrectable data had been 
reproduced. Of course, when such data is re-read and 
contains no errors or, if errors are present, such er- 
rors are corrected, a suitable ECC STATUS indication 
is supplied to control circuit 28A. whereupon the in- 
terrupt command that had previously been produced 
by the control circuit is terminated. As a result, the re- 
read multiplexed data is decoded and displayed. Of 
course, and as has been described above, during the 
interval that the disk drive is controlled to re-read the 
record medium, a still video image and muled sound 
are displayed such that, during this interval, a user is 
not provided with an annoying or disagreeable dis- 
play. 

Thus, it is seen that, when a re-read operation is 
carried out because uncorrectable errors are pres- 
ent, the decoders are inhibited from decoding the vid- 
eo and audio data stored in video and audio buffers 
SAand 8A until there-read data is successfully repro- 
duced from the record medium and supplied to the 
video and audio buffers. Likewise, clock register 26A 
is inhibited from counting the clock signals supplied 
by clock generator 27 until the data re-read from the 
record medium is reproduced successfully and sup- 
plied to the video and audio buffers. 

While the present invention has been particular- 
ly shown and described with reference to preferred 
embodiments, it will be readily appreciated that vari- 
ous modifications may be made without departing 
from the scope of the invention. It is intended that the 
appended claims be interpreted to cover the embodi- 
ments specifically disclosed herein, those changes 
and modifications which have been discussed above 
and all equivalents thereto. 



Claims 

1. Apparatus for reproducing video data from a re- 
cord medium on which is recorded in multiplexed 
form the video data, reference time data repre- 
senting a reference time and video time data rep- 
resenting the time at which decoding of said vid- 
eo data reproduced from the record medium 
should begin, said apparatus comprising: 

reference time data separating means 
(5A) for separating said reference time data from 
the reproduced multiplexed data and for generat- 
ing timing data based thereon; 

a video buffer (6A) for temporarily storing 
the video data and video time data which are re- 
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produced from said record medium; 

a video time data extractor (30) coupled to 
said video buffer for extracting the video time 
data from said video buffer; 

a video decoder (7) for decoding the video 5 
data temporarily stored in said video buffer, said 
video buffer being connected to said video time 
data extractor and to said video decoder; and 

synchronizing control means (31) coupled 
to receive and compare said generated timing io 
data and said extracted video time data and for 
controlling said video decoder as a function of 
the comparison. 

2. Apparatus according to claim 1. wherein said ref- is 
erence time data separating means (5A) includes 

a clock generator (27) for generating clock sig- 
nals, and means (26; 26A) for incrementing a ref- 
erence time established by said reference time 
data with said clock signals to generate said tim- 20 
ing data. 

3. Apparatus according to claim 2, wherein said 
synchronizing control means is operative to 
sense when said timing data is substantially 25 
equal to said extracted video time data to initiate 

the decoding of said video data by said video de- 
coder. 

4. Apparatus according to claim 3, wherein said 30 
synchronizing control means (31 ) is further oper- 
ative to sense when said timing data and said ex- 
tracted video time data differ from each other by 

at least a predetermined amount, thereby indicat- 
ing a synchronizing error. 35 

5. Apparatus according to claim 4, for reproducing 
said video data which is recorded on said record 
medium as a series of video pictures, each video 
picture exhibiting a picture interval, wherein said 40 
synchronizing control means (31) is additionally 
operative to delay by a picture interval the decod- 
ing of video data by said video decoder (7) when 

said extracted video time data exceeds said tim- 
ing data by at least said predetermined amount 45 

6. Apparatus according to claim 5. wherein said 
synchronizing control means (31) is still further 
operative to cause said video decoder (7) to skip 

to a next picture interval for decoding said next so 
picture interval when said timing data exceeds 
said extracted video time data by at least said 
predetermined amount. 



Apparatus according to claim 1, for use where 
the multiplexed data recorded on said record me- 
dium further includes audio data and audio time 
data representing the time at which decoding of 



55 



said audio data reproduced from the record me- 
dium should begin, including an audio buffer (8A) 
for temporarily storing the audio data and audio 
time data which are reproduced from said record 
medium, an audio time data extractor (32) for ex- 
tracting the audio time data from said audio data 
reproduced from said record medium, and an au- 
dio decoder (9) for decoding the reproduced au- 
dio data temporarily stored in said audio buffer, 
wherein said audio buffer (8A) is connected to 
said audio time data extractor and to said audio 
decoder, and wherein said synchronizing control 
means (31) is further coupled to receive said ex- 
tracted audio time data and to compare said au- 
dio time data to said generated timing data for 
controlling said audio decoder (9) as a function 
of the comparison. 

8. Apparatus according to claim 7, wherein said 
synchronizing control means (31) is additionally 
operative to compare the extracted video time 
data to the extracted audio time data for control- 
ling a selected one of the video decoder (7) or the 
audio decoder (9) in response to the comparison. 

9. Apparatus according to claim 3, for reproducing 
said video data which is recorded on said record 
medium as a series of video pictures exhibiting 
respective picture intervals, comprising means 
for generating an interrupt command to tempor- 
arily interrupt the reproduction of new multi- 
plexed data from said record medium, and where- 
in said video decoder (7) is responsive to said in- 
terrupt command to delay until the interrupt com- 
mand terminates the decoding of a next picture 
interval of video data. 

10. Apparatus according to claim 9, wherein said 
means (26A) for incrementing a reference time is 
inhibited for the duration of said interrupt com- 
mand, and wherein said synchronizing control 
means (31) is further operative to sense when 
the extracted video time data is greater than said 
timing data to cause said video decoder not to de- 
code the video data of said next picture interval. 

11. Apparatus according to claim 10, wherein said 
means (26A) for incrementing is enabled when 
the interrupt command terminates, and wherein 
said synchronizing control means (31) is addi- 
tionally operative to sense when said timing data 
is greater than said extracted video time data to 
cause said video decoder (7) to decode said next 
picture interval of video data. 

12. Apparatus according to claim 7, comprising 
means for generating an interrupt command to 
temporarily interrupt the reproduction of new 
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multiplexed data from said record medium, and 
wherein the video and audio decoders (7, 9) are 
responsive to said interrupt command to delay , 
until said interrupt command terminates the de- 
coding of video and audio data stored in said vid- 5 
eo and audio buffers (6A, 8A). 

13. Apparatus according to claim 3, comprising 
means (28A) for generating a re-read command 

to cause re-reproduction of the multiplexed data io 
from a portion of said record medium and to 
cause said video decoder (7) to delay the decod- 
ing of video data temporarily stored in said video 
buffer (6A) until re-reproduced video data is sup- 
plied thereto. 15 

14. Apparatus according to claim 13, wherein said 
means (26A) for incrementing a reference time is 
inhibited until said re-reproduced video data is 
supplied to said video buffer (6A). and wherein 20 
said synchronizing control means (31) is further 
operative to sense when the extracted video time 
data is greater than said timing data to cause said 
video decoder (7) not to decode the video data in 
said video buffer. 25 



data is greater than said timing data to cause said 
video and audio decoders not to decode the vid- 
eo and audio data in the video and audio buffers 
(6A, 8 A), respectively. 



15. Apparatus according to claim 14, wherein said 
means (26A) for incrementing is enabled when 
re-reproduced multiplexed data is supplied to 
said video buffer (6A), and wherein said syn- 30 
chronizing control means (31) is additionally of>- 
erative to sense when said timing data is greater 
than said extracted video time data to cause said 
video decoder (7) to decode the video data then 

in said video buffer. \ 35 

16. Apparatus according to claim 7, comprising 
means (28A) for generating a re-read command 
to cause re-reproduction of the multiplexed data 
from a portion of said record medium and to 40 
cause said video and audio decoders (7, 9) to de- 
lay the decoding of video and audio data tempor- 
arily stored in said video and audio buffers (6A, 

8A), respectively, until re-reproduced video and 
audio data are supplied thereto. 45 

17. Apparatus according to claim 16, wherein said 
reference time data separating means (5A) in- 
cludes a clock generator (27) for generating clock 
signals and increment means (26A) for incre- so 
menting a reference time established by said ref- 
erence time data with said dock signals to gen- 
erate said timing data, said increment means be- 
ing Inhibited until said re-reproduced video and 
audio data are supplied to said video and audio 55 
buffers, and wherein said synchronizing control 
means (31) is further operative to sense when at 
least one of the extracted video and audio time 
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Defective images within this document are accurate representations of the original 
documents submitted by the appHcant. 

Defects in the images include but are not limited to the items checked: 

□ BLACK BORDERS 

□ IMAGE CUT OFF AT TOP, BOTTOM OR SIDES 



ZJ FADED TEXT OR DRAWING 

□ BLURRED OR ILLEGIBLE TEXT OR DRAWING 

□ SKEWED/SLANTED IMAGES 

□ COLOR OR BLACK AND WHITE PHOTOGRAPHS 

□ GRAY SCALE DOCUMENTS 

□ LINES OR MARKS ON ORIGINAL DOCUMENT 

□ REFERENCE(S) OR EXHIBIT(S) SUBMITTED ARE POOR QUALITY 

□ OTHER: 

IMAGES ARE BEST AVAILABLE COPY. 
As rescanning these documents will not correct the image 
problems checked, please do not report these problems to 
the IFW Image Problem Mailbox. 



BEST AVAILABLE IMAGES 




